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Abstracts An analysis of errors arising in linear filtering and prediction 
of samples of a function and its derivative is performed by 
the method of inverse probabilityo The results, showing the 
dependence of the errors on data accuracy, are presented in 
a graphical form o 

The following analysis is concerned with the problem of smoothing 
and prediction of a random time series when past and present sampled 
measurements of both the function and its first derivative are simultane- 
ously available o The discussion is limited to functions generated by a 
specific statistical process requiring that the second derivative of the 
function remain constant over each sampling interval with a Gaussian 
probability density distribution about a zero mean (cf* Fig. l)o It is 
also assumed that the values of the second derivative in each sampling 
interval are independent of each other* 
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Figure 1 
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The probability density distribution function of the second 
derivative is 
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irtiere the standard deviation OC is assumed to be knowio 

Since the second derivative is constant over each sampling 
interval, the sampled values of the first derivative and the function are 



• • " - 
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and 
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The noise in the samples of the function and its derivative is 
assumed to have independent Gaussian distributions. These are 



vrfN„) = ^ c 






and 
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in the function and the derivative respectively* 

Figo 2 shows a signal flow diagram of this proliLem in the 
complex frequency domain* Since only the second derivative is statistically 
prescribed, it is considered as the input in the diagram, i^ile Eqs. (2) 
and (3) generating the samples of the derivative and the function are 
represented by appropriate linear operate rso Here z « e"! denotes a 
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unit delay operator o The corrupted samples f and d are fed into a smoothing 
filter F» Since both the signal and the noise have Gaussian distributions, 
the optimum smoothing filter must be linear and can be synthesized by the 
Wiener-Lee method. This analysis, however, illustrates a more direct 
approach by the use of inverse probability. 
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Figure 2 



As a starting point, we assume the form of the probability 
distribution of the samples of the function and the derivative, given all 
the past and present data. Let L represent all data up to and including 



n 



the n-th sample* In particular, let 
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(6) 



where A, B, C, D $nd E are arbitrary constants, K. is a nonnalizing factor, 
and Y denotes i « By changing the variables to express the distribution 

about the mean, Eq. (6) reduces to 






(7) 
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Tlflien all transients have died out and when the system has reached steady 
state, the distribution described by Eq« (?) will become invariant and 
independent of n* In matrix notation, this distribution must attain the 
form 



w.(Myi:„)= i^^ 



Titi -i^Mvil 



C8) 



regardless of the value of n. Here Y ^^ ^^^ inverse of the correlation 
matrix w » 



$=?" = 






In the notation of Eq, (?), 



f = 
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Therefore, the values of the correlation coefficients 
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must remain the same for all values of n« 

By computing from the distribution expressed by Eq* (6) the 
form of distribution corresponding to the next higher value of n, and by 
comparing these expressions and equating respective correlation coefficients, 
it is possible to obtain and solve a set of simultaneous algebraic equations 
in A, B, and De 
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The first step in this procedure is to forms 
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v7(/„ vyx„.,v„^, a«-., L J)W^^v«., a«.,/L„-.") d^^X.^ ^--i 



Here, T and a denote X and X respectively. Using Eqs. (l), (2), (3), 
n n n n o* , , f 

and (6), and integrating, the above expression can be reduced to 






M^^.yi.^?}^ 'Tfrt''^ f^^) 



K 



where 



j5= A(i-B) +D+ 2^1 

^ = i|A(i-B)x,+[A(i-BXB-l>i]v«+Ac(i-i)-])Ej 
r = A< + [a(b-i)Vd]v^ + 2A(B-i)XftN/v» +2ACX, + 
+ i [ac (B-1^ + je] v^ + acS d e^ 

JVom Eqs.cCJi) and C5)t 



^^'"/^- L-> ;?b ^ 



_ (d»-X») ' 



a 0-1 



(12) 



and 

Since the noise in the samples of the function is assiamed to be 
independent of the noise in the samples of the derivative. 
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But, 






(15) 
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Substituting from Eqso (ll) and (lit). 



V(x„,V„/L„^ 






K" 



where 



XT = (^xiZ^ ^ ^hz^ i_ + r + S 

^" 2.a-»- ^ 2.^^ iff ^ ^^ 



and S is a function of f and d only^ 

n n "^ 



saiTple is • 



From Eq, (6) the corresponding eiqDression for the previous 



(16) 



Equating the coefficients of second degree terms in X and V and 
solving the resulting set of three simultaneous equations, one obtains^ 



A_ - ■h*\J^ 



'^ ' 



hrr^iji- 



(17) 



B = \-\ 



j)^ A {■k-'^f + -T^'. 
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^ - i'(l7r)"^\/ 4(7^17 



Jf + I 



4k^+k, 



^ ~ \/ai.» + w. ' '^>~ oc^^ Kl oc» ■ 



By using Eqs. (lO) and (l?)* it is now possible to comptite the 
correlation coefficients as functions of OC > 0* * and {!• The nonnalized 

non-dimensional ratios -« — j- and — » — ^ are functions of the parameters 

k^ and k^ only. They are plotted in Figs. lA and 2A as functions of k^ 

for two values of k. • For large values of k« these curves approach 

a'symptotieally the normalized variance of error in the smoothed samples 
of the function and its derivative in the case when the measured samples 
of the derivative are not available. 

It is of interest to investigate also the accuracy of the 
samples of the function and the derivative predicted one sampling interval 
into the future. Eqs* (2) and (3) can be written 



x,^, = x^ -t- v^ + X a„ 



Vr^+| = V^+ O-y^ 



(18) 



Since the mean of the acceleration is zero. 

Therefore, the expressions for the variance of predicted values are 



(19) 



(20) 



=;:^ 



O-pW = (nW^^= (^.-^^ + < 
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since a is independent of X and V • 
n ^ n n 

Eqs« (20) : are equi/ysHeilt to 



I O-p'H = ^vv + '^' 



(21) 



The normalized, non-dimensional ratios — J ^J and J* ^> 

are plotted in PigSo 3A and IjA as ftmctions of kp for two different 

values of k_ • For large values of kp these curves approach asjinptotically 

the normalized variance of error in the predicted samples of the function 
and its derivative in the case when only the measured sanples of the 
function are available* 

Fig» 5A shows the fimctional dependence of the variance of 
error of the smoothed and predicted samples of the function on the 
parameter k^ for one particular value of k^» 

To investigate the effect of acceleration on the accuracy 
of prediction, a plot of the variance of error in the predicted samples 
of the function against the variance of the probability density distri- 
bution of the second derivative is shown in Jig* 6A, The family of 
curves corresponds to several representative values of the standard 
deviation of the error in the measured sanples of the first derivative, 
while the standard deviation of the error in the measured samples of the 
function is ke^t constant • As can be seen from Fig« 6A, the less accurately 
we measure the first derivative, the more rapidly does the accuracy of 
prediction deteriorate with increasing variance of the second derivative© 

The results of this analysis describe statistically the 
errors in the output of an optimum linear smoothing filter in the mini- 
mum mean square error sense o This filter is realizable, and the associated 
smoothing equations can be obtained ICrom the mean of the distribution 
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described by Eq« (l6)« They are 



X.= )V,-^%('^n-^>%-f. -^ 
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VARIANCE OF ERROR IN PREDICTED SAMPLES 

vs VARIANCE OF ERROR IN MEASURED DERIVATIVE 
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